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A recent  paper  by  Einot  and  Gabriel  [1J  restates  a 
basic  result  for  multiple  range  tests,  which  had  earlier 
been  given  by  Tukey  4^^ant^  Spj0tvoll  4-5^  It  is  pointed 
out  that  this  result  requires  for  its  validity  an  assump- 
tion which  is  not  explicitly  provided  by  any  of  these 
earlier  versions.  There  is  also  some  discussion  of  a 
related  result. 
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Let  X^(i*l , . . . , s)  be  independently  distributed  with 
distribution 


PCX^x)  = FCx-Oi)  , (1) 

and  let  Y^  denote  the  i^  smallest  of  the  X's.  We  shall  be 
concerned  with  the  problem  of  grouping  the  o's  by  means  of  a 

multiple  range  test,  defined  in  terms  of  critical  values  C2 Cs 

as  follows.  As  a first  step  the  range  RS=YS-Yj  is  compared  with 
Cg : If  RS<CS,  the  0's  are  declared  indistinguishable  and  the 

procedure  terminates;  if  RS>CS,  the  e's  corresponding  to 
Y^  and  Yg  are  declared  to  differ,  and  the  two  (s-1) -ranges 


‘s-1,1 


VlYl  and  Rs,2  ■ VY2 


are  compared  with  C If  both  R's  are  less  than  Cs_j  the 

two  sets  of  o's  corresponding  to  (Yj,Y2 Ys-1^  and 

(Y2,...,Ys)  are  declared  indistinguishable  and  the  procedure 
terminates.  Otherwise  the  two  0's  corresponding  to  Y^,Yg  j 
and/or  the  two  0's  corresponding  to  Y2,Ys  are  declared  t0 
differ,  and  the  three  (s-2) -ranges  arc  compared  with  cs-2* 
and  so  on.  After  a set  of  means  has  been  declared  indistinguishable 
all  of  its  subsets  are  also  considered  indistinguishable  without 
further  test. 

To  complete  specification  of  the  procedure,  it  is  necessary 
to  decide  on  the  critical  values  C2*...,CS.  This  choice  is 
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typically  made  in  terms  of  the  probabilities 


ak  ■ piRkicki 


J9t 


where  denotes  the  range  of  k independent  X's  with  common 

location  parameter  0. 

A quantity  of  central  interest  to  many  investigators  of 
multiple  range  tests  is  the  probability  of  declaring  at  least 
one  pair  of  0's  to  differ  when  they  are  in  fact  equal,  say 

aQ  = sup  oCOj 6S)  (3] 

where 


a(6lt...,0  ) * P [at  least  one  false  significance  statement]. 

1 5 ®i»* • • iS  ( 4] 


The  fundamental  theorem  referred  to  in  the  title  relates  to 

a2 a^.  Suppose  that  the  0’s  fall  into  t groups  of  equal 

values  of  lengths  v^,...,vt;  without  loss  of  generality  let 
the  0's  be  numbered  so  that 


)i  * ...»  6 ; 0 . i 

1 V1  V1  1 


...  = 0 


w 


with  the  values  in  the  different  groups  being  distinct.  Then  the 
fundamental  theorem  states  that 


sup  a(e  . , . . . , 0 .)  = 1 - II  ( 1 -u  ) 
1 s i=l  i 


where  the  sup  is  taken  over  all  G’s  which  after  reordering 
satisfy  (5)  and  where  a^O. 

This  result  appears  to  have  been  stated  first,  rather  informally 
and  with  a sketch  of  a proof,  in  Chapter  3 of  Tukey's  unpublished 
book  (1953)  on  multiple  comparisons;  it  was  discovered  again  by 
Spjfltvoll  and  plays  a central  role  in  his  unpublished  1971  paper 
[5];  and  now  finally  has  appeared  in  the  recent  paper  by  hinot 
and  Gabriel  (1975) . 

The  theorem  in  fact  requires  an  additional  assumption.  A 
natural  sufficient  condition  for  its  validity  which  the  earlier 
authors  may  have  assumed  tacitly  but  which  they  did  not  state 
explicitly  is 


C2  1 C3  <_  ...  £ • 


Actually,  it  is  enough  to  assume  that 


C2  i c3  1 


v <_  Cj  for  all  j > max  v^  . (8) 


That  the  theorem  is  not  correct  without  some  restriction  on 
the  C's,  can  be  seen  from  the  example  s=3,  Cj=(),  Oj  = 02  < 63 
and  0j  -*•  Then  the  probability  afej.G^.Oj)  of  declaring 

0^  to  differ  from  0^  exceeds  the  probability  that  is 

between  and  X2  (since  in  that  case  |X2-X1|>C3)  which 

is  1/3,  regardless  of  the  value  of  while  the  right  hand 

side  of  (6)  is  o^. 


-4- 


Condition  (7)  is  of  course  trivially  satisfied  for  the 
Newman-Keuls  procedure  defined  by 

oi £ “ - • - = (x ^ (9) 

and  by  Tukey's  T-method  defined  by 

C2  = ...  = C . . (10) 

Inspection  of  Table  B3  of  Harter  [2]  suggests  that  it  also  holds 
for  Duncan's  procedure  when  F is  normal.  Whether  in  that  case 
it  is  true  for  arbitrary  F,  we  do  not  know. 

Because  of  the  importance  of  the  fundamental  theorem  it  may 
be  worth  making  available  a proof.  The  proof  below  is  essentially 
that  given  by  Spjtftvoll  and  sketched  in  the  other  papers. 

Proof  of  (6),  assuming  (7). 

When  the  0's  satisfy  (5), 

t 

a(8, 9J  < P(  U [R.  > C ])  (11) 

1 s ” i-1  1 vi 

I 

where  denotes  the  range  of  the  X's  corresponding  to  the 

i**1  group  of  0's  in  (5).  The  right  hand  side  of  (11)  is  equal  to 

, t 

1 - P (R . < C for  all  i J = 1 - 11  (l-ay  ) (12) 

1 vi  i=l  i 
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which  shows  that  the  right  hand  side  of  (11)  is  an  upper  bound 
for  ot(8^,...,0g). 

Note  that  assumption  (8)  is  needed  to  insure  the  validity 
of  (11)  . 

To  prove  that  the  right  hand  side  of  (6)  is  a sharp  upper 

bound  for  a(6.,...,6  ) suppose  that  the  difference  between  t he 

values  of  successive  groups  in  (5)  is  A.  Then  as  A -*■ 

the  probability  a(0  ,...,0  ) tends  to  the  right  hand  side  of 

X s 

(11)  and  hence  to  (12)  and  this  completes  the  proof. 

Condition  (7)  plays  a role  in  another  result  mentioned  both 

by  Tukey  and  in  [1],  This  is  the  fact  that  is  the  maximum 

probability  of  declaring  the  set  (0^,.  . . ,0^1  to  be  nonhomogcneous 

when  in  fact  0,  = ...  =0..  That  this  result  is  not  correct 

1 l 

without  some  restriction  is  again  shown  by  the  example  given 
after  (8) . 

Let  us  now  prove  that  it  does  hold  under  (7)  or  the  weaker 
assumption 


Ck  > Cx  for  all  k > i . (13) 

The  probability  of  declaring  the  set  { 0 ^ 6-1  not  to  be 

homogeneous  is 


P[Rk>Ck  for  all  ranges 
1 l Pk  P [max  (Xj  , . . . 


containing  , . . . ,X^  ] 


- min  (Xx  . ,X.)  > CjJ 


(14) 
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where  is  the  probability  that  if 

min  (X. X.)  = Y and  max  (X.,...,X:)  = Y 

i 1 a i 1 b 

then  b-a  a k-1.  If  (13)  holds,  the  right  hand  side  of  (14)  is 
increased  when  is  replaced  by  C . and  then  becomes  a.. 

For  applications,  the  special  cases  of  the  theorem  when  F 
is  either  normal  or  exponential  are  of  particular  interest.  One 
may  tjien  wish  to  extend  the  theorem  to  the  case  of  an  unknown 
common  scale  parameter.  What  continues  to  be  true  is  that 

t 

a(01,...,QJ  < i - n (l-u  ) . (15) 

b i= 1 vi 

To  see  this,  suppose  that  each  Xi  is  replaced  by  X^S 
where  S is  an  estimator  of  the  scale  parameter,  which  is  assumed 
to  be  independent  of  the  X 's.  Then  the  Student ized  ranges 
R*  * R^/S  are  positively  dependent  (see  for  example,  Lehmann 
[4,  Ex.  l(ii)]),  and  the  proof  of  (6)  requires  no  changes  until 
the  last  step,  where  equality  in  (12)  must  be  replaced  by  an 
inequality:  the  left  hand  side  is  smaller  than  or  equal  to 

the  right  hand  side. 

Although  the  right  hand  side  of  (15)  is  no  longer  a sharp 
upper  bound  (and  the  upper  bound  may  obtain  for  different 
configurations  than  in  the  proof  of  (6)),  it  seems  likely  that 
in  the  normal  case,  when  o is  estimated  with  at  least  moderate 
degrees  of  freedom,  the  least  upper  bound  is  close  to  the  right 


-7- 


hand  side  (see  e.g.  Hartley  [3]). 

While  conditions  (7),  (8)  and  (13)  obviously  continue  to 
hold  for  the  Newman-Keuls  and  for  Tukey's  T-method,  they  are  no 
longer  satisfied  in  the  normal  case  with  the  probabilities 

= 1 - (l-ct2)k  1 (lb) 

proposed  by  Duncan.  It  appears  from  inspection  of  the  Tables 
supplied  for  Duncan's  procedure  that  he  is  in  fact  not  advocating 
(16).  Rather,  he  recommends  the  stated  value  of  a but  lower 
values  of  , k>2,  as  needed  to  get  condition  (7)  to  hold. 
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